System and method of enriching non-linkable media representations in a network by enabling an overlying hotlink canvas

ABSTRACT

A network capable of providing rich media presentations includes a network server and a client station. The network implements HotMedia architecture to transmit the presentation including non-linkable media from the server to the client station. The server transmits the presentation as a streaming file in a framework of frames including a header frame, thumbnail frame, meta frame, media frame and end-of-stream frame. The client station includes an action enabling kernel and a client master module. The action enabling kernel contains a table lookup of action triggering inputs and consequent action commands for hotlinking. The master module controls a selection process of the various types of media involved in the presentation and provides a signal to the action enabling kernel to provide an appropriate action handler to the server. When a media frame is encountered the master module checks to determine that a media object has been created to handle the media frame. If not, the master fetches the media object from the server and creates an instance of the media object to render the media frame. The rich media file may also include meta frames with range and action subtypes for the media. The range and action frames are the meta data for hotlink compositions and actions. When the first meta frame is received, the master fetches the action enabling kernel and a hotlink canvas from the server. The master delivers the meta frames to the action enabling kernel. The hotlink canvas receives hot link composition from the action enabling kernel and displays hotlinks in the hotlink canvas by overlaying a transparent panel on top of the non-linkable media whereby the non-linkable media becomes interactive and hyperlinkable. The hotlink canvas provides the following functions: Query media current position and state; Forward media position and state to the action enabling kernel; Receive contending hotlink candidates from the action enabling kernel; Pick one hotlink among a set of hotlink candidates; Compose hotlinks by receiving hotlinks meta data from the action enabling kernel; Display range contours of hotlinks on the media object by overlaying a hotlink canvas; Perform an action specified; Request the action enabling kernel to handle an action; and decouple hotlinks in otherwise linkable media.

RELATED APPLICATIONS

[0001] 1. Ser. No. ______ entitled “Framework for ProgressiveHierarchical and Adaptive Delivery Rich Media Presentation andAssociated Meta Data”, filed ______ (SE9-98-033).

[0002] 2. Ser. No. ______ entitled “Personalizing Rich MediaPresentations Based on User Response to the Presentation”, filed______(SE9-98-028).

[0003] 3. Ser. No. 09/100,418 entitled “Progressive to Relieve Deliveryof Interactive Descriptions and Render it for Electronic Publishing ofMerchandise” filed Jun. 20, 1998 (SE9-98-004).

[0004] 4. Ser. No. ______ entitled “System and Method for Tracking UserInterations and Navigation During Rich Media Presentations”, filed______ (SE9-99-011/1963-7344).

[0005] 5. Ser. No. ______ entitled “Method for Non-linear Transformationand Interpolation for Unifying Hotlinks Between Heterogeneous MediaRepresentations”, filed ______ (SE9-99-004).

[0006] All of the above-related applications are assigned to the sameassignee as that of the present invention and are fully incorporatedherein by reference.

BACKGROUND OF THE INVENTION

[0007] (1) Field of the Invention

[0008] This invention relates to multimedia networks, systems andmethods of operation. More particularly, the invention relates tosystems and methods for enriching non-linkable media representations ina network by enabling an overlying hotlink canvas.

[0009] (2) Description of Prior Art

[0010] In recent years, there has been a sizeable growth in the use ofrich media over the World Wide Web as more and more individuals andinstitutions are beginning to realize the web's potential in a broadrange of applications including electronic commerce, education training,news, etc. Examples of rich media include animation, audio, 3-D,panoramas, and videos. There are two apparent clusters of rich mediatechnology. One at the low end and the other at the high end whichhampers effective deployment of some rich media in Internet basedapplications. The “low end” cluster comprises static images and simplenon-interactive animations (typically animated GIFs) which are easy todeploy and therefore have widespread usage. The “high end” clusterscomprises richer and more natural experiences with largerinteractivities, such as panoramas, 3-D, streaming audio/video, andcomposite media (e.g., MPEG-4), but the difficulty of deployment haslimited widespread usage. A novel scaleable architecture called HotMediabridges the gap between the two clusters thereby achieving widespreadweb penetration. A key feature of the technology is a suitable deliveryfile format that can contain heterogeneous compositions of media bitstreams as well as meta data that defines behavior, composition andinteraction semantics. The delivery file format enables the creation oflightweight single file representation of interactive, multistagepresentations resulting in multiple media type contents. At the core ofHotMedia client is a smart content algorithm that infers media typesfrom the incoming data stream and fetches the media renderer components,user-interface components and hyper-linked action components, all justin time, resulting in progressive and context driven enrichment of theuser experience. Further details related to HotMedia architecture aredescribed in Ser. No. ______ entitled “Framework for ProgressiveHierarchical and Adaptive Delivery Rich Media Presentation andAssociated Meta Data”, filed ______ (SE9-98-033), supra and in IBMResearch Report 21519[97069] entitled “The Hot Media Architecture:Progressive & Interactive Rich Mediafor the Internet” by K. G. Kumar etal, dated July 1999.

[0011] Often instances of rich media incorporate links to otherpresentations to expand a user experience. The process of clicking on alink in a media for transfer to the other presentation is referred to as“hotlinking” or “hyperlinking” which is further described in U.S. Pat.No. 5,841,978 entitled “Networking Using Steganographically EmbeddedData Objects” issued Nov. 24, 1998 and U.S. Pat. No. 5,918,012 entitled“Hyper Linking Time Based Data” issued Jan. 29, 1999. Sometimes richmedia are non-linkable to other presentations. It would be desirable tohave non-linkable rich media supplemented to provide hotlinking to otherpresentations. Alternatively, it would be desirable to de-couplehotlinking from media.

[0012] Typically, hotlinks have been tightly integrated into supportedmedia. For example, NetShow available from Microsoft supports hotlinksin the temporal domain. All hotlinks are written to its AFS file formatalong with the media. RealNetwork G2 uses Synchronized MultimediaIntegration Language(SMIL)(http://www.trainingsupersite.com/realplayerG2/) for a compositionof temporal hotlinks. Neither RealNetwork nor NetShow support hotlinksother than in the temporal domain. Veon's (http://www.veon.com/v-active)with integration of RealNetwork G2 provides both spatial and temporalhotlinks uses SMIL as output format. None of the above-mentionedsupported media provide a generic plug and play framework fornon-linkable media to become hyperlinkable. Nor does such hotlinksupported media provide, in real-time, a separate hotlink meta datacomprised in advance and delivered in addition to a transparent panel asa hotlink canvas for implementation of hotlinking in otherwisenon-linkable media.

SUMMARY OF THE INVENTION

[0013] An object of the invention is a multimedia network and method ofoperation for enriching non-linkable media representation forhyperlinking.

[0014] Another object of the invention is a multimedia network andmethod of operation providing a generic plug and play framework fornon-linkable media to become hyperlinkable.

[0015] Another object is a multimedia network and method of operationproviding a hotlink canvas as an overlay on non-linkable media forhyperlinking.

[0016] An object is a multimedia network and method of operationproviding an overlay canvas for decoupling hotlinks in accompanyingmedia.

[0017] An object is a hotlink canvas as an overlay in a multimedianetwork composed in advance and delivered with rich media forimplementing hotlinking in accompanying non-linkable media orde-coupling hotlinking in accompanying media otherwise linkable.

[0018] These and other objects, features and advantages are achieved ina network capable of providing rich media presentations. The networkincludes a network server and a client station and implements HotMediaarchitecture to transmit a presentation in rich media includingnon-linkable media from the server to the client station. The servertransmits the presentation as a streaming file in a framework of framesincluding a header frame, thumbnail frame, meta frame, media frame andend-of-stream frame. The client station includes an action enablingkernel and a client master module. The action enabling kernel contains atable lookup of action triggering inputs and consequent action commands.The master module controls a selection process of the various types ofmedia involved in the presentation. When a media frame is encounteredthe master module checks to determine that a media object has beencreated to handle the media frame. If not, the master fetches the mediaobject from the server and creates an instance of the media object torender the media frames. The rich media file may also include metaframes with range and action subtypes for the media. The range andaction frames are the meta data for hotlink compositions and actions.When the first meta frame is received, the master fetches the actionenabling kernel and a hotlink canvas from the server. The masterdelivers the meta frames to the action enabling kernel. The hotlinkcanvas receives hotlink composition from the action enabling kernel anddisplays hotlinks by overlaying a transparent panel on top of thenon-linkable media whereby the non-linkable media becomes interactiveand hyperlinkable. The non-linkable media is not responsible to displayhotlinks, track hotlinks or trigger actions on the hotlink The hotlinkcanvas performs the following functions: Query media current positionand state; Forward media position and state to the action enablingkernel; Receive contending hotlink candidates from the action enablingkernel; Pick one hotlink among a set of hotlinks candidates; Composehotlinks by receiving hotlink meta data from the action enabling kernel;Display range contours of hotlinks on the media object by overlaying ahotlink canvas; Perform an action specified; and Request the actionenabling kernel to invoke an action. With the hotlink canvas,non-linkable media does not need to be aware of any hotlinks andcorresponding action handling. The media can be plugged into the hotlinkcanvas framework and become interactive and hyperlinkable.

DESCRIPTION OF THE DRAWINGS

[0019] The invention will be further understood from the followingdetailed description of a preferred embodiment taken in conjunction withan appended drawing, in which:

[0020]FIG. 1 is a representation of system incorporating HotMediaarchitecture and incorporating the principles of the present invention.

[0021]FIG. 2 is a representation of a HotMedia file format for streamingrich media for use in the system of FIG. 1.

[0022]FIG. 3 is a representation of a client station for enrichingnon-linkable media representations by enabling an overlying andaccompanying hotlink canvas of the non-linkable media for hyperlinkingin the system of FIG. 1.

[0023]FIG. 4 is a flow diagram describing a method of operation forenriching otherwise non-linkable media for hyperlinking using anoverlying, transparent, accompanying hotlink canvas in the system ofFIG. 1.

[0024]FIGS. 5A & B are a representation of a hotlink canvas generated ina system of FIG. 1 using the process of FIG. 4.

DESCRIPTION OF PREFERRED EMBODIMENT

[0025] In FIG. 1, a multimedia information system 100 implementsHotMedia architecture and includes an HTTP or dedicated server 102coupled to a multimedia network 108, typically the Internet. The serveris further coupled to a storage medium 104 which stores presentationfiles in rich media created by standard authoring tools for delivery toa client station 106 coupled to the network and serving a user 110. Theclient station includes a presentation and user interaction logic unit112 accessed by the user through a client terminal device 114. Thepresentation files 104 are supplied to the client station as streamingdata on presentation bus 116. The user's interaction with thepresentation data is returned to the server 102 as interaction data onbus 118. The presentation files and interaction data are exchanged inthe network between the server and the client station using standardHTTP protocols. A user interaction tracking server 120 monitors theuser's intentions, preferences and attitudes with respect to thepresentation files and exchanges data with the server 102. The trackingserver is more fully described in Serial No. ______ entitled “System andMethod for Tracking User Interations and Navigation During Rich MediaPresentations”, filed ______ (SE9-99-011/1963-7344), supra.

[0026]FIG. 2 shows a HotMedia presentation file 200 in a framework 201which is essentially a sequence of frames types comprising header 202,thumbnail 204, meta 206, media 208, and an end of stream 210. The firstframe is the header frame 202. The header frame is actually followed bythe thumbnail frame 204. After these frames a sequence of other framesoccurs and in no pre-mandated order or number. The header frame 202 isonly one whose presence is mandatory in the format. The most degenerateyet useful version would have a header frame followed by a thumbnailframe 204. Media frames 208 appear in all other instances. Meta frames206 are present only in cases where non-default behavior andconfiguration are desired on cases where hyperlinked action semanticsare to be incorporated. All frames have a similar 12 bytes initialsection that enables a uniform procedure for their identification to atype and frame label as well as the determination of their size. TheHotMedia file format is created to have minimum overhead and maximummodularity. The format makes it suitable for optimal delivery of a lowbandwidth as well as for rich experiences over high bandwidth.

[0027] The header frame 202 includes a frame header 212 which providesinformation about frame size 214, types and flags 216 and frame labels218. The header frame 202 also includes media information 220 containingdefinition on different media tracks that may be contained in the file200 General information 224 in the header frame 202 provides the classname of the code that renders the media type on the client station. WhenHotMedia kernel code on the client side parses the media trackinformation on the file header and if it encounters the specification ofa class name, the media type field is ignored and the code specified bythe class name is sent from the server in order to render the data ofthe track in question. The class name permits the introduction of wholenew media types into the presentation. No changes or additions to theclient kernel code are needed so long as the media objects implementsthe interfaces specified in the HotMedia framework 201 for first classmembers of a media object set.

[0028] The thumbnail frames 204 carry a minimalistic representation ofthe information shared by the HotMedia file framework 201. For example,if the information carried in the file were a description ofmerchandise, the thumbnail would carry a single image. Thumbnail framesmake possible providing the user a quick introduction to the subjectwith minimal code and data transfer. Since users pay attention to detailonly when the subject is of some interest, it would be wasteful for suchdata and codes to enable anything beyond the initial experience unlessan interest is indicated. In addition to a frame header, the thumbnailframes also carry parameters for producing image pan and animationeffects on the single image (all not shown).

[0029] Meta frames 206 carry specification of non-media specificinformation pertaining to enablement of hyperlinked actions from mediacontext and tracking of interaction. Action semantics associated withmedia segments can be expressed in HotMedia files 200 using range 205and action 207 subtypes. Range frames 205 are made up of range recordsthat identify and label spatio-temporal segments of media. A spatialrange can be described by a rectangular or elliptical contour. Temporalranges can refer to a time range in milliseconds for a real timemedia-like audio or a count range for non-real-time media likeanimation. The range specification can also express a combination ofspace and time.

[0030] Action records 207 may be pre-programmed into the HotMedia file200 for the execution of many types of action in the context of apresentation. Action frames can carry multiple action records allpertaining to a single actionable context, namely the presentation ofmedia segment as specified by a range. Action records are thespecification mechanism for all types of actions that can be triggeredduring the context of presenting a certain media segment while in acertain state of the media object. Actions can belong to a variety oftypes that include LINK to specify hyperlinking; DISPLAY to specify thedisplay of contours, cursor changes, etc; PLAY SOUND to create soundeffects in various contexts; and TRACK to specify the tracking ofinteractions and events associated with a user experience. Alsocontained in an action record is the specification of an action trigger.The triggers for actions can be user interaction, presentation stateupdates or player state updates. An example would be the coming in toview of a certain segment of a presentation, the movement of mouse intoa spatio-temporal range of a presentation, the click of the left mousebutton within the present temporal range of the presentation, thecompletion of loading of a segment of the media data and so forth.Although the range record specifying a media segment associated withmost action triggers are of type spatial, temporal or both, there aresome situations where the range type is inconsequential. A range typeDONTCARE is designed for such situations. An example is where the actionis determined entirely by the internal state of the media objectproducing the completion of data loading trigger. The final piece ofinformation contained in an action record is the data for action. Thesize of this data and its interpretation is different for each actiontype and subtype. The data information is where for example, the targetURL string is found when the action type is LINK and the text string,font and color information when the action type is DISPLAY.

[0031] The media frame 208 includes a frame header 222 and in additioncontains media bit stream data 209, initialization data 211, behaviordata 213 and code 215. The behavior data or initialization data definethe behavior and configuration of a corresponding media playerrespectively. Media bit stream data belonging to a particular mediatrack can be carried over multiple frames and these frames can beinterleaved with meta frames and frames belonging to other media tracks.Media frames are identified by frame type and track identifier ascarried in their header 222. The frame type and track identifier enabletrue multiplexed delivery and hence ideal for static or dynamicproportioning of various media tracks over limited bandwidth. Mediaframes can also often contain codes 215 that render the media type onthe client station. The code in turn can be physically present or couldbe a URL reference. When present, the code is separated from the file onthe server side 102 (see FIG. 1), and thereafter the code or data can bemade available for on demand delivery. In the case of a URL reference tocode, the code is fetched from a remote HTTP server to be similarly madeavailable on demand.

[0032] The end-of-stream frame 210 contains a frame header 226 and is amarker that signals the end of the entire presentation associated with aHot Media file 200. Frames belonging to multiple media tracks and metadata can be multiplexed in the HotMedia file. The end of stream frame isvaluable to the client station in recognizing the end of each HotMediafile data stream which may otherwise be impossible when streaminitialization data for each stream do not announce their respectivelengths.

[0033] Turning to FIG. 3, the Client side station 106 will now bedescribed in conjunction with processing the presentation file datastream 200. The server 102 provides a first streaming HotMedia file 300comprising a series of frames 301 ₁ . . . 301 _(n), previously describedin conjunction with FIG. 2. The frames 301 ₁ . . . 301 _(n) may containmeta frames with range and action subtypes. A HotMedia client master 303receives the frames 300 and as soon as a meta frame is encountered withrange and action subtypes, the master verifies to see if an actionenabling kernel 307 has been created. If not, the master 303 obtainsaction enabling kernel code 304 and media object code 306 from theserver 102 and instantiates the code 304 in an action enabling kernel307 and creates an instance of the code 306 as a media object 308 on theclient terminal 114 (see FIG. 1). The client master 303 delivers thesequence of frames 300 to their proper owner. Media frames 309 aredelivered to the media object 308 handling the media track. Meta frames310 of the range 311 and action 312 types are delivered to the actionenabling kernel 307 and stored in range tables 313 and action tables315.

[0034] The range table 313 and an action table 315 are updated based onmeta frames included in the file 300. The action enabling kernel buildsrange and action tables out of the information contained in the rangeand action frames respectively. An entry is contained in the range tablecorresponding to each range record in the arriving frame. Theinformation contained in the range record is used as data for the entry.The table contains entries corresponding to ranges responding to anymedia track in the file 300 and no particular order is mandated.Similarly, an entry is created in the action table corresponding to eachaction record in the arriving action frame. The information contained inthe action record is used as data for the entry. A cross-reference indexis also added to the range table to enable easy access of thedescription of the range with which the action in question isassociated.

[0035] As the media object 308 receives media related data 306 from theclient master and commences the rendering of the media it will also bereceiving user input to mouse and keyboard interaction. The media objectmay also be undergoing internal state changes pertaining to completionof data loading, commencement or rendering and so forth. The mediaobject can signal the occurrences of this user input or state changes tothe action enabling kernel 307. On receiving them the action enablingkernel regards the signals as triggers and as the occasion to verify thepresence of actionable situation. When relevant to the media object inquestion, triggers can be associated with the display of every newimage, mouse activity within an applet space and media object statechanges, such as the completion and loading of all images. It isentirely up to the media object which triggers it chooses to send to theaction enabling kernel. Associated with the action enabling kernel arethe action handlers 320, 321, 322 for responding to triggers having beeninitiated by the media object. The action enabling kernel may signal themaster module 303 to fetch hotlinked files in response to some triggerssuch as a REPLACEURL. The master module 303 provides data request 319transmitted to the server once a request is submitted by the actionenabling kernel. For example, action handler 320 may perform a VIEWchange on the client terminal 114 (See FIG. 1) in response to a changetrigger. Action handler 321 may perform a PLAYSOUND. Action handler 322may perform a LINK. Various other actions can be performed in responseto triggers such as MOUSEMOVE, REPLACEURL, etc. Triggers generate othertriggers depending on the context. For example, a MOUSE MOVE may cause amouse to enter range or a mouse exit range depending on where the mousewas previously located.

[0036] Further details of the construction and operation of the Clientstation in the HotMedia Architecture of FIG. 1 are described in Ser. No.______ entitled “Personalizing Rich Media Presentations Based on UserResponse to the Presentation”, filed ______ (SE9-98-028), supra.

[0037] In those instances where HotMedia files are non-linkable mediarepresentations, i.e. there are no meta frames containing range andaction records for hotlink composition, the master module 303 may enablethe non-linkable media for hotlinking by fetching hotlink canvas code331 from the server and instantiates the hotlink canvas object 332. Inaddition, a set of meta frames would be delivered to the action enablingkernel from the server for hotlink composition. The hotlink canvascreates a transparent panel 500 (See FIG. 5) which is overlayed on topof the media object. By receiving hotlink composition data from theaction enabling kernel, the hotlink canvas displays hotlinks overlyingthe otherwise non-linkable media. The media is not responsible todisplay hotlinks, track hotlinks, or trigger actions on hotlinks. Themedia is only responsible to report its spatio-temporal position andcurrent state whenever requested by the hotlink canvas. In effect, thehotlink canvas is a liaison between a media object and the actionenabling kernel. The hotlink canvas performs the following functions:

[0038] 1. Querying media current positions and state.

[0039] In order to display hotlinks properly the hotlink canvas requestsfor the current status of the media object frequently. The currentstatus of the media object comprises any user interaction by eithermouse or keyboard input, current mouse position, i.e. (x, y)coordinates, current temporal position in milliseconds, and the currentstate of the media object.

[0040] 2. Forwarding media's position and state to the action enablingkernel.

[0041] The hotlink canvas sends the current status of the media objectto the action enabling kernel to be verified if any hotlink(s) istriggered.

[0042] 3. Receive contending hotlink candidates from the action enablingkernel.

[0043] The action enabling kernel picks a set of candidates from therange table and forwards them to the hotlink canvas. The ranges of allpicked are matched to the one raised by the hotlink canvas.

[0044] 4. Selecting one hotlink among a set of hotlink candidates.

[0045] The hotlink canvas may choose which hotlinks are triggered fromcandidates forwarded by the action enabling kernel.

[0046] 5. Composing hotlinks by receiving hotlink meta data from theaction enabling kernel.

[0047] The hotlink canvas receives meta data from the action enablingkernel and stores them internally for hotlink composition anddisplaying.

[0048] 6. Displaying range contours of hotlinks on the media object byoverlaying a transparent panel.

[0049] The hotlink canvas creates a transparent panel overlaying on topof the media object to display range contours of hotlinks without anyawareness of the media object.

[0050] 7. Performing an action specified.

[0051] For example, if the action type is DISPLAY and sub-type isRANGE_CONTOUR, the hotlink canvas is ideally suited to perform thisaction.

[0052] 8. Requesting the action enabling kernel to handle an action.

[0053] Instead of performing an action, actions can be handled by one ofaction handlers provided by the action enabling kernel.

[0054] 9. Unifying representations of hotlinks.

[0055] The hotlink canvas transforms media information represented inthe media space to a uniform representation. The hotlinks are identifiedby a uniform procedure independent of non-linear representations ofmedia in the context of the hotlink canvas.

[0056] In FIG. 4 a process 400 will be described in conjunction withFIGS. 1-3 for constructing a hotlink canvas enabling a non-linkablemedia representation for hyperlinking in a network. The process isentered at start point (S) after which a streaming rich media file 300is received from the server 102 in block 401. The streaming rich mediafile is received by the HotMedia client master module 303 in block 403.The HotMedia client master module 303 starts to fetch the media objectcode 306, the action enabling kernel code 304 and the hotlink canvascode 331 from the server 102 in block 405 while the rich media file isstreaming to the HotMedia client master. A test 407 is performed by themaster module 303 to determine if any media frames 309 have beenreceived. A “yes” condition delivers the media frames to the mediaobject 308 in block 409, afterwhich the process returns to the entrypoint S. A “no” condition transfers the process to block 411. A test isperformed in block 411 to determine if the file contains any metaframes. A “no” condition initiates a test in block 443 to determine ifthe streaming rich media file from the server 102 is complete. A “yes”condition in block 443 transfers the process to entry point A which willbe described hereinafter. A “no” condition in block 443 transfers theprocess to block 401. Returning to block 411, a “yes” conditiontransfers the process to block 413 in which the meta frames aredelivered to the action enabling kernel 307. The action enabling kernelin a test 415 determines if any hotlinks are present in the meta frames.A “no” condition transfers the process to entry point A. A “yes”condition transfers the process to blocks 417 and 419. In block 417hotlink composition data in terms of range and action data from theaction enabling kernel are entered in the hotlink canvas. In block 419 atest is performed to display any spatial hotlinks in the meta frame. Thetest 419 transfers the process to entry point A for a “no” condition. A“yes” condition transfers the process to block 421 in which the hotlinkcanvas transforms the information reported by the media object into auniform representation. The representations of hotlinks in the contextof the hotlink canvas are unified and independent of non-linearities ofthe media. In block 423 range contours of the hot links are displayed byoverlaying a transparent panel as a hotlink canvas on top of the mediaobject after which the process transfers to entry point A.

[0057] At entry point A test 425 is performed to determine if any userinteraction has occurred during the media presentation. A “no” conditioncycles the process to entry point A. A “yes” condition transfers theprocess to block 427 in which the media object 308 reports its positionand states with specific trigger types to the hotlink canvas. In block429 the hotlink canvas performs a non-linear transformation andinterpolation to unify hotlink representations over nonlinear media ifnecessary. In block 431 the hotlink canvas forwards the information tothe action enabling kernel 307. In block 433 the action enabling kernelsends back a set of contending hotlink candidates to the hotlink canvas.The hotlink canvas picks one hotlink from a set of hotlink candidatesbased on the range and action data received from the action enablingkernel in block 435. A test is performed in block 437 to determine ifthe corresponding actions are ideally suited to be performed by thehotlink canvas itself. A “yes” condition transfers the process to block441 in which the actions are carried by the hotlink canvas after whichthe process transfers to entry point A. A “no” condition initiates ahotlink canvas request to the action enabling kernel to perform aspecific action in block 439 after which the process transfers to entrypoint A. The action enabling kernel determines if any actions need to beexecuted by specific action handlers 320-322. Those actions would beforwarded to action handlers 320-322 to be executed. The process remainsin a waiting condition at entry point A after all actions have beenperformed until user interaction occurs in the media presentation afterwhich blocks 425-441 are repeated or another streaming rich media fileis received from the server after which the entire process is repeatedbeginning with step 401 through 443 is performed.

[0058] Further details of unifying representations of hotlinks betweennon-linear media in block 421 and 429 are described in Ser. No. ______entitled “Method for Non-linear Transformation and Interpolation forUnifying Hotlinks Between Heterogeneous Media Representations”, filed______ (SE9-99-004), supra.

[0059] In FIG. 5A, the client terminal 114 (See FIG. 1) displaysnon-linkable media representations (not shown) for incorporatinghotlinks by an overlying transparent panel 501 as a hotlink canvas. Thetransparent panel is constructed by the hotlink canvas 332 and isjuxtaposed with respect to the non-linkable media representation. Thehotlinks can be incorporated into the panel 501 in accordance with theprocess 400 described in FIG. 4.

[0060] In FIG. 5B, a transparent panel 503 can serve as a hotlink canvasto decouple hyperlinks embedded in media displayed on the terminal 114.The media with embedded hyperlinks need to be reconstructed in the formof a streaming rich media file 300 described in FIG. 3. The processincludes parsing media frames, separating hyperlinks information,authoring media frames in accordance with the file 300 and transforminghyperlinks information to meta frames in accordance with file 300.

[0061] While the invention has been shown and described in connectionwith a preferred embodiment various changes may be made therein withoutdeparting from the spirit and scope claimed and defined in the appendedclaims:

We claim:
 1. A system of enriching non-linkable media representationsfor hotlinking in a network implementing a hot media architecture,comprising: a server coupled to the network for transmitting a streamingrich media file to a client station; a HotMedia client master in theclient station; means included in the master for fetching an actionenabling kernel and a hotlink canvas from the server after receiving ameta frame from the server; means for composing hotlinks in the hotlinkcanvas after receiving the meta data from the action enabling kernel;and means for overlying and coupling the hotlink canvas in a transparentpanel on the non-linkable media whereby the non-linkable media becomesinteractive and hyperlinkable.
 2. The system of claim 1 wherein thestreaming rich media further comprises: non-linkable media in aframework of frames including a header frame, a thumbnail frame, a metaframe, a media frame and an end of stream frame.
 3. The system of claim1 further comprising: means for delivering the meta frame to the actionenabling kernel.
 4. In a system of enriching non-linkable mediarepresentations for hotlinking in a network implementing a HotMediaarchitecture including a server coupled to the network for transmittingto a client station a streaming rich media file including non-linkablemedia in a framework of frames including a header frame, a thumbnailframe, a meta frame, a media frame and an end of stream frame and aHotMedia client master in the client station, a method for providing ahotlink canvas to enrich non-linkable media representations, comprisingthe steps of: composing hotlinks; querying the state of a media objectin the client station; displaying range contours of the hotlinks; andperforming actions composed in the hotlinks to enrich the otherwisenon-linkable media representations.
 5. The method of claim 4 furtherincluding the step of composing hotlinks by receiving hotlink meta datafrom an action enabling kernel.
 6. The method of claim 4 furtherincluding the step of querying media current spatio-temporal positioninformation and the current state of the media object.
 7. The method ofclaim 5 further including the step of forwarding media spatio-temporalposition information and the current state of the media object to theaction enabling kernel.
 8. The method of claim 6 further including thestep of receiving the information of contending hotlink candidates fromthe action enabling kernel.
 9. The method of claim 4 further includingof the step of picking one hotlink among a set of contending hotlinkcandidates.
 10. The method of claim 4 further including the step ofdisplaying the range contours of hotlinks on the media object byoverlaying a transparent panel on top of the media object.
 11. Themethod of claim 10 further including the step of a non-lineartransformation and interpolation for unifying hotlinks betweennon-linear media representations in the context of the hotlink canvas.12. The method of claim 4 further including the step of performingspecified actions if the corresponding hotlink is triggered.
 13. Themethod of claim 5 further including the step of requesting the actionenabling kernel to handle specified actions corresponding to a triggeredhotlink.
 14. The system of claim 1 further comprising: means forproviding hyperlinking capability in a real time environment fornon-linkable media representation in a network.
 15. The system of claim1 further comprising a server coupled to the network capable ofproducing and transmitting real time media presentations; and a realtime encoding studio resident in a server coupled to the network fortransmitting both real time non-linkable media and a set of metainformation of hotlinks to a HotMedia client station.
 16. The system ofclaim 1 wherein a real time encoding studio provides a real-timeauthoring capability of multiplexing a non-linkable media and a set ofmeta information of hotlinks to a streaming rich media file in HotMediaframework
 17. A hotlink canvas for enriching non-linkable mediarepresentations for hotlinking in a network implementing a hot mediaarchitecture including a server coupled to a client station via anetwork, comprising: means for constructing a transparent paneloverlying a media object including the non-linkable representations inthe client station; means for composing hotlinks in the transparentpanel; and means for enabling hot linking of the non-linkable mediausing the hotlinks in the transparent panel.
 18. The hotlink canvas ofclaim 17 wherein the transparent panel further comprises: means fordecoupling hotlinks in media representations at the client station. 19.The hotlink canvas of claim 17 wherein the client station furthercomprises: means responsive to a trigger for implementing a hotlink thetransparent panel.
 20. The hotlink canvas of claim 17 wherein the serverfurther comprises: means for composing the hotlink canvas in advance ofdelivering the non-linkable media to the client station